Noise spectra of stochastic pulse sequences: application to large scale magnetization 

flips in the finite size 2D Ising model 
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We provide a general scheme to predict and derive the contribution to the noise spectrum of a 
stochastic sequence of pulses from the distribution of pulse parameters. An example is the magne- 
tization noise spectra of a 2D Ising system near its phase transition. At T < T c , the low frequency 
spectra is dominated by magnetization flips of nearly the entire system. We find that both the 
predicted and the analytically derived spectra fit those produced from simulations. Subtracting this 
contribution leaves the high frequency spectra which follow a power law set by the critical exponents. 

PACS numbers: 05.40.Ca, 75.40.Gb, 73.50.Td, 75.40.Mg 



Noise due to random pulses is ubiquitous. Examples 
include switching the rotational direction of the flagellar 
motor in Escherichia coli bacteria switching in elec- 
trical resistance 0], and switching between degenerate 
ordered phases of a finite size system. Yet another exam- 
ple is crackling noise in which slowly driven systems pro- 
duce sudden discrete outbursts spanning a broad range of 
sizes Q • Instances of crackling noise include the sound of 
paper crumpling, Barkhausen noise from domain move- 
ment in ferromagnets 0, 0] i and seismic activity during 
earthquakes Q. 

The question is how these pulses are reflected in the 
features of the power spectra commonly used to charac- 
terize noise. The answer could be used to estimate or 
predict the pulse noise spectrum as well as to separate 
the pulse contribution to the noise spectrum from other 
sources. For example, suppose one wants to determine 
the critical exponents of a second order phase transition 
from the noise spectra [7|, la l9( . In a finite size system 
with a discrete broken symmetry, switching between de- 
generate ordered phases will also contribute to the noise 
spectra, and it is important to separate out this contri- 
bution before determining the critical exponents. 

Previous work calculated the noise from stochastic 
pulse sequences 0, El E El- Machlup showed that 
random telegraph noise consisting of square pulses with 
exponentially distributed durations has a Lorentzian 
noise spectrum [l(| ■ Subsequently others [HI, [H, HH 
considered a more general pulse shape and distribution, 
though their theory cannot be applied if the pulse shape 
depends on the pulse index m, e.g., if the pulses alternate 
in sign as shown in Fig. |TJ In this paper we determine the 
noise spectrum from a distribution of pulse parameters 
for a much more general sequence of stochastic pulses 
with amplitudes that can (but need not) depend on m. 
We then analyze the magnetization noise spectra of a fi- 
nite size 2D Ising system near the phase transition. We 
map the collective jumps (or flips) in the magnetization 
to a sequence of discrete pulses, and use our algorithm 
to predict the contribution to the noise using reasonable 
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FIG. 1: A representative sequence of stochastic pulses. 



assumptions about the distribution of pulse parameters 
and characteristic frequencies from the noise spectrum. 
We check this prediction with the spectra found from 
Monte Carlo simulations. We then check our algorithm 
by determining the distribution of pulse parameters from 
the magnetization time series, and derive noise spectra in 
excellent agreement with that found from Monte Carlo 
simulations. We find that the low frequency magneti- 
zation noise spectra have a distinct signature due to the 
global magnetization flips of the whole spin system which 
is particularly evident below T c . Subtracting this contri- 
bution yields the high frequency power law noise spec- 
trum dictated by the critical exponents of the infinite 
system. 

We now present a general formulation to find the en- 
semble averaged noise spectrum of a sequence of stochas- 
tic pulses X(t) consisting of K pulses. As shown in 
Fig. [TJ each pulse has a duration r with an interval q 
where the signal is zero between two successive pulses. 
The maximum height H(m) of the mth pulse has two 
factors: H(m) = h ■ a(m), where ft is a random vari- 
able, and a(m) contains the functional dependence on 
to. We only consider the case where a(m) — A m , A is 
a constant, and < \A\ < 1. \A\ < 1 corresponds to a 
decay envelope. Denote r, h, and q for the mth pulse 
by r m , h m , and q m , respectively. X(t) can be expressed 
as X(t) = ^2m = iX m (t — t m ), where the mth pulse is 
x m (t - t m ), and t m = YlT=i ( r j + Qj)i m > 2 is the cor- 
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responding time delay. (The first pulse starts at ti =0.) 
The mth pulse x m (t') starts at if = t — t m = 0. 

We denote the Fourier transform of the pulse x m (if) by 
F m (uj, r m , h m , q m )- Then the Fourier transform Fx(w) of 



Doing the sums in Rk yields 
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exp[— iuit m ] contains the phase relation be- 
tween pulses. The power spectrum of X(t) is 
S x (uj) = 2F x {lj)F x (uj)/t k , where oj > 0, and t k 
is the total duration of X(t). Sx(w) can be written as: 
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t k S x {uj) =2^2\F m (w,r m ,h m ,q m )f + 4Re ^ ^ 

m— 1 L m— 1 n— 1 

We assume the following: (a) The values of a pulse's 
parameters are independent of those of other pulses ex- 
cept for a(m). (b) r, g and /i have the combined distri- 
bution p(r, h, q) which is same for all pulses, and other 
pulse parameters (if any) are independent of r, h and 
q. Then the ensemble averaged Fourier transform of 
the pulse x m {t') is J J J drdqdhA m F(uj,r,h,q)p(r,h,q), 
where u) is the angular frequency, and the overline, e.g., 
A, denotes the average of over parameters other than r, 
q and h (e.g., different pulse shapes), (c) F(u,r,h 7 q) is 
independent of the pulse index m. 

From assumption (a), F m /A m and F n /A n , as well as 
(rm+qm) and (r n +q n ) {m^=n), are uncorrelated. After 
taking the ensemble average over pulses and all parame- 
ters, we use assumptions (b) and (c) to obtain: 



(t k Sx(w)) = 2BI + 4Rc [AI 2 I 3 R K ] , 



(3) 



where (...) is an ensemble average, B = 
(\A\ 2 - \A\ 2K + 2 ) / {I - \A\ 2 ) for all \A\ 2 < 1, and 
B = K when \A\ 2 = 1. We define 
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e-^ r +^p(r,h,q)drdq, 
F(u,r, h, q)p(r, h, q)drdq, 
F*(LU,r,h, q )e-^ r+ i>p(r,h,q) 
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Defining q' = r + q and po(?') = A°l dhf£°p(r, h, q' - 
r)dr, Ji can be written as Zj = J 00 e -1 "" 3 p (q')d q ' . 
\h\ < f^\e-^'\p (q')dq' = 1 unless p (<z') = 
Em a m^ (<?' - q'm) where g£ - q\ = (i, j and I 

are integers), a m > and J2 m a ™ = 1 \XM- Thus when 
A' — ► oo, the power spectrum is (w > 0): 
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where C* = |A| 2 / [A(l - |A| 2 )] + o{R- 1 ) for all |A| < 1, 
and C = 1 when |A| 2 = 1. 

, Eq. © can be used to calculate the average noise spec- 
Ifum of any random pulse sequence satisfying our three 
assumptions. (Fluctuations uncorrelated with the pulses 
are not contained in Eq. ©.) A pulse spectrum need not 
be a Lorentzian, e.g., it may have a bump. An example is 
a time series of trapezoidal pulses such as the simplified 
signal in Fig.[2ja). This illustrates how the duration n of 
the flat part of the signal and the rise time t 2 are reflected 
in the spectra. We find that simulated time series pro- 
duces a spectrum that agrees with the spectrum derived 
from Eq. © as shown in Fig. [3J The pulses are trape- 
zoidal when T\ and t 2 both have an exponential distri- 
bution. We take the time derivative of the time series to 
obtain a sequence of square pulses as shown in Fig. [2Kb) 
with the exponential distributions pi(q) = Pi{t\) and 
Pi(r) = Pi(t 2 ) where p x (y) = exp [-y/{y)\ /(y), (y) is 
the mean value of y. We use Eq. © to derive the spec- 
trum using A = — 1, the Fourier transform F(u),r,h,q) 
of a square pulse, andp(r, h,q) — Pi(q)pi{r)5(h — (1/r)). 
We divide the result by uj 2 to undo the derivative. When 
(n) = (t 2 ), Fig. [3j shows that the spectrum is flat at low 
frequencies with a small bump at higher frequencies. It 
is well known that summing over Lorentzians with differ- 
ent characteristic frequencies yields 1/f noise. However 
Fig. [3J implies that doing a similar sum over the spectra 
of trapezoidal pulse sequences with nonzero r 2 will give 
1// Q noise where a > 1 . 

As a physical example we now apply Eq. ^ to study 
the noise spectra of the magnetization M per spin of the 
2D Ising model near the phase transition. The Hamil- 
tonian is: Ti = —JJ2i<j s i s ji where the spin Si = ±1, 
denotes the nearest neighbor sites on a square lat- 
tice and we set the ferromagnetic exchange J — I. In 
the thermodynamic limit this model has a second-order 
phase transition at the temperature T c — 2.2692/fcs (IBj 
where ks is Boltzmann's constant. 

We do Metropolis Monte Carlo simulations to obtain 
the magnetization time series. We apply periodic bound- 
ary conditions to a lattice with N — L 2 points, where 
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FIG. 2: (Color online) (a) The original and simplified time 
series (solid lines) of the magnetization for the 2D Ising model 
(L = 20) at T c . (b) The time derivative of the simplified 
signal shown in (a) . (c) Distributions of ti from simulations 
at T c . Enveloping fits are P2{t2) with (n) = 38.45, 127.3, and 
517.5, a\ = 342.5, 3942.7, and 68414, for L = 10, 20, and 40, 
respectively. 
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FIG. 3: Power spectra of a trapezoidal signal ((ri) = 1000, 
(tsj) = 1000). The signal varies between and 1. n and T2 are 
exponentially distributed. Symbols are for spectra averaged 
over 100 runs, each run having 2 23 time steps. The solid lines 
are from Eq. ([6]) as described in the text. 



L=10, 20, 30, 40. We start each run from a high tem- 
perature (T > T c ), and then gradually cool the system 
to T = 0.5 < T c . We define T c for the finite system 
as the temperature at which the specific heat Cy has a 
maximum. At each temperature, we wait until the sys- 
tem equilibrates (according to the protocol in Q) be- 
fore recording the time series for at least 10 6 Monte 
Carlo time steps per spin (MCS). The noise spectral den- 
sity S x (u>) of a time series x(t) with duration t x is nor- 
malized so that the total noise power per time step is 



S x (oj) = cr x , where a x is the vari- 
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ance of x(t) (7|. 

In Fig. dja), we show an example of the magnetiza- 
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FIG. 4: (Color online) Power spectra of the original (sym- 
bols) and simplified (lines) magnetization time series (length 
N K = 2, 621, 440, 10 runs) of the 2D Ising model (L = 20) at 
different temperatures. 



tion time series at T c . The noise spectra are shown in 
Fig. [U For T > T c , starting from high frequencies, we 
find that the spectra are increasing for decreasing fre- 
quencies. However, near a characteristic frequency Wfe nee , 
the spectra stop increasing, and at lower frequencies they 
plateau. 

When cooling the system below T C) the system goes 
from a disordered paramagnetic phase to an ordered fer- 
romagnetic phase. By spin symmetry, the distribution 
P(M) of the magnetization per spin is symmetric about 
M = 0. So in the ordered phase the system is equally 
likely to be in either an M = M or M = — M state, where 
±M are the most probable values of M. Thus for a finite 
size system the magnetization may change from one state 
to the other and as a result, a jump in the magnetization 
is created. This is reflected in the noise spectrum. Below 
T c the spectrum is similar to the one at T c for uj > ui^nee ■ 
However, as the frequency decreases below Uknee there 
is a second increase in the spectrum which, as we shall 
show, is due to magnetization flips of almost the entire 
system. In this frequency range (u>j ump < lo < ujknee), 



Sm(u>) 



(see Fig. [4j. Below the characteristic fre- 



quency (J j um p, the spectrum plateaus. 

We can use our algorithm to predict the contribution 
of the magnetization flips to the noise spectrum. Wc 
can approximate the time series of these jumps by a 
trapezoidal signal as shown in Fig. [5^. t\ is the dwell 
time in the flat region of up or down magnetization, 
and T2 is the duration of the jump. To apply Eq. ([6]) 
to obtain noise spectra, we take the time derivative of 
the simplified signal to obtain a sequence of stochastic 
square pulses (see Fig. [5b). Thus n and r 2 correspond 
to q and r in Eq. ([5]). If each time interval has a con- 
stant probability to switch, then t± follows an exponen- 
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tial distribution pi(ri) with mean (n): Pi{ti) = pi(q). 
From the noise spectrum at T = 2.1 < T c , we esti- 
mate (ti) ~ l/cjjujnp ~ 10 5 MCS. When the magneti- 
zation of the system flips, it overcomes an energy barrier 
centered at M = resulting in a bimodal distribution 
P{M). To find p 2 (r 2 ), we write t 2 = t a + t b , where t a 
is the time to go from M = —M to M = 0, and t b is 
the time to go from M = to M = M. We assume 
that t a and t b follow the same log-normal distribution 
p' 2 (z) = exp[-(lnz-p) 2 /(2CT 2 )]/(zV27TCT 2 ), where z = t° 
or t b . p and er are determined from the mean of r 2 given 
by (t 2 ) = 2exp[/> + (<r 2 /2)] and the variance of r 2 given 
by cr 2 2 = 2(exp[2p + 2a 2 ] - (r 2 ) 2 ). Since r 2 = r = t a + t b , 
the distribution p 2 {r) = p 2 (r 2 ) is given by the convolu- 
tion p 2 {r 2 ) = J dyp' 2 (y)p' 2 (T 2 - y). From the T = 2.1 
noise spectrum, we estimate (t 2 ) ~ 1/ojknee ~ 100, and 
(j T2 - (r 2 )/2~ 50. 

Now we can apply Eq. ([B]) to analyze the magnetiza- 
tion of the 2D Ising model. For the derivative (Fig. (2b) 
of the simplified magnetization series, A = —1, the 
Fourier transform of a square pulse is F(u>,r,h,q) — 
h(l — e~ lujr )/(iuj), and q is independent of r. We as- 
sume h = 1.3/t 2 . Thus the combined distribution be- 
comes p(r,h,q) = pi(q)p 2 (r)S(h — 1.3/t 2 ). Doing the 
integrals in Eq. ([4]) numerically, and dividing the result 
of Eq. © by 10 1 to undo the derivative, we obtain the 
spectra shown in Fig. [4] which is a good approximation at 
low frequencies. Thus we predict that pulses dominate 
the low frequency spectrum. 

We can check this prediction by extracting a simpli- 
fied trapezoidal signal that represents a series of magne- 
tization jumps as shown in Fig. [2k- In the flat regions 
with small fluctuations, we replace the original magne- 
tization time series by the mean magnetization in that 
region. To find the jumps, we start from points with 
M = 0, then move both forward and backward in time. 
A jump is identified if and only if M in one direction 
achieves M — SM, and in the other direction achieves 
—M + SM, where SM > is the offset. In Fig. [4] for 
T < T c , we find that the spectra of the original and 
simplified magnetization series match at low frequencies 
(lu <C LUknee)- At T c up to frequencies one order of mag- 
nitude higher than the crossover frequency, the power 
spectrum for the simplified signal fits the spectrum of the 
original signal very well. This is why this contribution 
must be subtracted from the spectrum before extracting 
the high frequency power law dictated by the critical ex- 
ponents. In Fig. [4] the high frequency noise at T c follows 
S(u> > LOknee) ~ lo~^ m where hm — 1-8. This matches 
well with the scaling theory prediction Pm — 1-8. 

From the simplified time series, we can extract the pa- 
rameters for the pulse distributions to derive the pulse 
contribution to the noise by using Eq. |6|) in the same 
way as we did for the estimate. We use h = C(T)/t 2 
where C(T) is a function of the temperature T. We use 
the same distributions for n and r 2 , and obtain values 
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FIG. 5: (Color online) Power spectra for the magnetization 
jumps of the simplified magnetization signal at T — T c and 
T = (2.1/fcs) < T c for L = 20. At T c , (ti) = 1030.7, (r 2 > = 
127.3, a 2 T2 = 3942.7. At T = 2.1/fes, (ti) = 1.169 ■ 10 5 , 
(t 2 ) = 115.1, <T? 2 = 1718.3. 

for (n), (t 2 ), and ct 2 2 from the simplified time series. As 
shown in Fig. [He), p 2 (r 2 ) fits very well with the actual 
distribution of r 2 for different system sizes. We obtain 
the spectra shown in Fig. [5] which is an excellent fit to 
the spectra of the simplified magnetization signals for 
T < T c . The square- wave-like time series of the deriva- 
tive of the simplified signal (Fig. (2]d) yields a Lorentzian- 
like power spectrum. Undoing the derivative with a fac- 
tor of 1/uj 2 yields a high frequency noise spectrum that 
goes as 1/lu 4 . 

In summary, our method predicts and derives the noise 
spectra of stochastic pulse sequences from the distribu- 
tion of pulse parameters. It can be used to separate out 
the contribution of pulses from other contributions to the 
spectra. It can even be used for noise spectra not derived 
from a time series. 

This work was supported by DOE grant DE-FG02- 
04ER46107. 



[1] E. Korobkova et ai, Nature (London) 428, 574 (2004); 
Y. Tu and G. Grinstein, Phys. Rev. Lett. 94, 208101 
(2005); E. A. Korobkova, T. Emonet, H. Park and P. 
Cluzel, Phys. Rev. Lett. 96, 058105 (2006). 

[2] M. B. Weissman, Rev. Mod. Phys. 60, 537 (1988), and 
references therein. 

[3] J. P. Sethna, K. A. Dahmen, and C. R. Myers, Nature 
(London) 410, 242 (2001). 

[4] M. Celasco, F. Fiorillo, and P. Mazzetti, Nuovo Cimento 
B 23, 376 (1974). 

[5] S. Zapperi, C. Castellano, F. Colaiori, and G. Durin, Na- 
ture Phys. 1, 46 (2005). 

[6] H. Houston, H. M. Benz, and J. E. Vidale, J. Geophys. 
Res. 103, 29895 (1998). 

[7] Z. Chen and C. C. Yu, Phys. Rev. Lett. 98, 057204 
(2007). 

[8] J. C. A. d'Auriac, R. Maynard, and R. Rammal, J. Stat. 

Phys. 28, 307 (1982). 
[9] K. B. Lauritsen and H. C. Fogedby, J. Stat. Phys. 72, 

189 (1993); K. Leung, J. Phys. A 26, 6691 (1993). 



■5 



[10] S. Machlup, J. Appl. Phys. 25, 341 (1954). 
[11] T. Lukes, Proc. Phys. Soc. 78, 153 (1961). 
[12] C. Heiden, Phys. Rev. 188, 319 (1969). 
[13] M. Celasco and A. Stepanescu, J. Appl. Phys. 48, 3635 
(1977), and references therein. 



[14] P. Mazzetti and G. P. Soardo, IEEE Trans. Inform. The- 
ory 13, 552 (1967). 

[15] K. Huang, Statistical Mechanics (John Wiley & Sons, 
Inc., New York, 1987), 2nd ed. 



